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CHAPTER 1 
INTRODUCTION 

In the past, the longitudinal handling qualities of an aircraft 
were determined almost entirely by the modal characteristics of the 
classical rigid body modes (short period and phugoid). These modes 
dominate the conventional aircraft's dynamics, and their modal para- 
meters (i.e. damping and natural frequency) exhibit a definite correla 
tion with pilot opinion ratings. Unfortunately, beyond the realm of 
conventional aircraft, criteria based on these parameters alone are 
inadequate. The addition of other modes, whether they be due to 
structural dynamics or to augmentation has been shown to seriously 
affect pilot opinion rating. 

In the early 70's, Neal and Smith^ hypothesized that "pilot 
rating is a strong function of the pilot's compensation required to 
achieve good low frequency performance and the pilot/vehicle oscilla- 
tory tendencies that resulted." Equating good tracking performance 
with closed-loop frequency response characteristics, they devised a 
"pilot-in-the-loop" analysis capable of explaining problems the pilot 
might observe in pitch attitude tracking. Unfortunately, the method 
has a few drawbacks. 

These drawbacks are typical of classical pilot models applied to 
handling qualities prediction in that even if given a hypothesized 
form of the pilot's control-loop structure, the task still includes 
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selecting parameters such that the resulting model mimics the input- 
output behavior of the pilot. And herein lies the difficulty with 
pilot transfer functions that are often impossible to measure, and 
methods of pilot-model parameter selection that often appear to be 
dependent on "miracles and black magic." 

Once the barrier of "conjuring-up" parameters is broken, these 
methods are usually straightforward, with elements of the closed-loop 
performance and the pilot model utilized to predict/explain pilot 
opinion ratings. However, breaking this barrier still remains the key 
to successfully gauging pi lot/ vehicle performance. 

To side step the "black magic" of the classical approach, con- 
sider another development of the early 70's; that is the optimal- 
control model (OCM) of human behavior. The OCM, a product of optimal 
control and estimation theory, needs no a priori knowledge of the 
pilot loop structure. Also, the parameters of the multi loop pilot 
transfer -functions can be computed as part of the optimal control 
solution. Of course, these benefits are partially offset since pilot 
strategy, as reflected by cost functional weightings of the quantities 
to be minimized, must be determined. 

The objective of this study, then, is a better pilot modelling 
technique via optimal control theory, and still conceptually approach 
the pilot-rating-prediction problem in a manner similar to Neal and 
Smith. 

This thesis is divided into the following chapters to provide 
the background material and the methodology needed for the new approach 
in handling qualities prediction. Chapter 2 presents the Neal and 
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Smith method by considering their interpretation of pilot strategy 
and the factors influencing pilot opinion rating. Chapter 3 gives a 
detailed account of the optimal control model's development and struc- 
ture. And, Chapter 4 focusing on the possibility of implementing the 
optimal -control model in the analysis, synthesizes the tracking task 
in the context of the OCM and presents the proposed OCM analysis, 
complete with a discussion of the results. Chapter 5 finally presents 
the summary and conclusions of the research. 
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CHAPTER 2 

THE ANALYSIS OF NEAL AND SMITH 

The Neal and Smith's investigation of the early 70 's had a two- 
fold objective: to provide data on the effects of Flight Control System 

(FCS) dynamics and to develop a design criterion capable of pinpoint- 
ing pilot problem areas encountered in performing a given task. 

To meet the first objective, two pilots evaluated a total of 51 
basic configurations of FSC/short period dynamics in flight. A block 
diagram of the vehicle dynamics and a listing of parameters defining 
23 of the configurations simulated in flight are presented, respective- 
ly, in Figure 2.1 and Table 2.1. These in-flight simulations provided 
pilot conments concerning the effects of adding a single FCS zero and 
a single FCS pole to eight baseline short period configurations engaged 
in combat- related manuevers. In addition to comments, the pilots 
assigned an overall pilot rating (Cooper-Harper) and a PIO (pilot- 
induced-oscillation) rating to each configuration. 

The Cooper-Harper Pilot Rating Scale, shown in Figure 2.2 repre- 
sents a numerical summary of an aircraft's suitability to perform a 
given task. The ten-point scale rates an aircraft based on the level 
of system controllability, the attainable level of performance, and 
the required pilot compensation. Incidentally, pilot rating is also 
related to the PIO rating that quantifies the aircraft's tendency to 
oscillate during the performance of the task. Truly, an aircraft's 



Stick Pitch 



Figure 2.1 Block Diagram of Standard Configuration 


Table 2.1 Configuration Suimiary 

















Figure 2.2 Cooper-Harper Rating Scale 


description 

NUMERICAL ] 
RATING ! 

NO TENDENCY FOR PILOT TO INOUCE UNCE5IRA8LS 
MOTIONS 

I 

UNDESIRABLE MOTIONS TEND TO OCCUR WHEN 
PILOT INITIATES AfiRUPY MANEUVERS OR ATTEMPTS 
TIGHT CONTROL. THESE MOTIONS CAN BE PREVENTED 
OR EUMINATEO BY PILOT TECHNIQUE. 

7 

UNCESIRA8LE MOTIONS EASILY INOUCSO WHEN PILOT 
INITIATES ABRUPT MANEUVERS OR ATTEMPTS TIGHT 
CONTROL. THESE MOTIONS CAN SE PREVENTED OR 
ELIMINATED 8UT ONLY AT SACRIFICE TO TASK PER. 
FORMANCS OR THRGUOH CONSIDERABLE PILOT 
ATTENTION AND EFFORT. 

3 

t 

OSCILLATIONS TEND TO DEVELOP WHEN PILOT INITIATES 
ABRUPT MANEUVERS OR ATTEMPTS TIGHT CONTROL . 
PILOT MUST REDUCE GAIN OR A 0 ANCON TASK TO 
RECOVER. 

4 

DIVERGENT OSCILLATIONS TEND TO DEVELOP WHEN 

pilot initiates abrupt maneuvers or attempts 
TIGHT CONTROL. Pi LOT MUST OPEN LOOP 9Y RELEASING 
OR FREEZING THE STICK. 

s 

DISTURBANCE OR NORMAL PILOT CONTROL MAY 
CAUSE OIVERGE.NT OSCILLATION .PILOT MUST OPEN 
CONTROL LOOP 3Y RELEASING CR FREEZING THE 
STICK. 

6 


Figure 2.3 PIO Tendency Rating Scale 
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oscillatory tendencies can seriously affect the pilot's attainable 
level of performance. Figure 2.3 presents the six-point PIO Tendency 
Rating Scale. The descriptions associated with the numerical ratings 
will play an important role in evaluating the results of the proposed 
alternate method to be presented later. 

For now, these descriptions and their rating scales simply enumer- 
ate problem areas the pilot encounters. Thus, predicting these ratings 
would achieve Neal and Smith's second goal. And since pilot rating is 
intimately correlated with PIO rating, predicting the former would be 
sufficient to achieve the objective. 

Returning to the first objective, preliminary results, comprised 
of pilot comments, pilot ratings, and PIO ratings for a cross section 
of the aircraft flight tested, concluded that the addition of FCS 
dynamics "can drastically alter the airplane's short-period response." 

A group of aircraft, containing the same short-period characteristics, 
but a varying set of FCS pole-zero pairs, demonstrated the degrading 
effect certain FCS dynamics can have on pilot opinion. As an example 
consider the aircraft of Group 2. Here, the basic short period con- 
figuration 2D received a good pilot rating of 2.5. However, upon the 
inclusion of configuration 2G's FCS dynamics, the pilot rating fell 
to 8, a poor rating. A similar trend exists for Group 1's dynamics, 
but in one case, IB, the pilot rating improved with added FCS dynamics. 
Evidently, short period characteristics alone cannot adequately pre- 
dict an aircraft's handling qualities. 

Moreover, the difficulties of using existing open-loop criterion 
to explain all the results of this experiment led to the development 
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of an alternate approach: - the "pilot-in-the-loop" analysis,, Based 
on pilot comments, this approach assumes that the pilot opinion rating 
is largely determined by the precision of pitch attitude control. In 
particular, pitch attitude tracking, the ability to rapidly acquire 
and track distant air and ground targets, became the backdrop of the 
Neal and Smith Analysis. 

To analyze the effects of various FCS dynamics on performing the 
proposed task, a suitable model of pitch attitude tracking was sought. 
Neal and Smith selected the compensatory tracking model of Figure 2.4. 
The pilot, modelled as a simple lead-lag filter with a time delay and 
gain, is considered to operate only on the difference between the 
aircraft's attitude and the commanded attitude. The pilot's time delay 
(taken as 0.3 sec) included the effects of perceptual delays and 
neuromuscular lags associated with most manual control systems. 


Given this pilot's controller structure, the need turns to find- 
ing the pilot parameters (K n , T_ , T ), and Neal and Smith went on 

p P 1 p 2 

to propose the closed loop characteristics representative of a pilot's 
perception of tracking strategy. To aid in the coming discussion the 


following terminology should be noted 

(1) I- is the open-loop transfer function of the aircraft plus FCS 
h s 



is the open-loop transfer function of the aircraft plus FCS 
plus pilot 


(3) is the closed-loop transfer function of the aircraft plus 

c s 

FSC plus pilot, which is related to — by 
n e„ 









( 2 . 1 ) 


With the ultimate goal of understanding how the pilot actually flies 
the tracking mission, the investigation began by asking the fundamental 
question; What is the pilot actually trying to do? 

Clearly, the pilot wants to acquire the target quickly and pre- 
dictably, with a minimum of overshoot and oscillation. Referring to 
Figure 2.5, the analysis interpreted the phrase "To acquire the target 
quickly and predictably" as meaning the pilot wants to attain a certain 

bandwidth and below this frequency, keep the magnitude (|— ) ■ relatively 

9 c 

close to 0 dB. Bandwidth (Bw) was defined as the frequency at which 

the closed-loop phase angle of (J— ) is -90 degrees. Neal and Smith 

c 

continued the interpretation of this phrase by correlating the desire 

"to minimize oscillation" with minimizing the closed-loop resonant 

peak |— | . They noted typically that pilot strategy was a trade- 

°c max 

off between striving for acceptable Tow frequency performance and 
eliminating the accompanying oscillations. 

The Neal-Smith investigation concluded that "pilot rating is a 
function of the compensation required to achieve good low frequency 
performance and the oscillatory tendencies that result." The analy- 
sis defined the pilot compensation in terms of the phase angle 


T ,S + 1 

A a A f—Ej 

* pc 5 v T_„s + 1 


p2“ 


0 )' 


=Bw 


( 2 . 2 ) 


in their pilot model. It is frequently interpreted as a measure of the 
pilot's physical and mental "workload" required. 




~dB 




BW 


Figure 2.5 Neal-Smith Pilot Strategy in Tracking 
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Therefore, the key to the analysis centered on determining the 
two measures, pilot compensation and magnitude of the resonant peak, 
hypothesized to correlate with pilot rating. To do so, pilot 
parameters (Kp, T -j , T^) were chosen to reflect the pilot's strategy 
by meeting the following empirical closed-loop performance standards: 

(1) A bandwidth of 3.5 rad/sec ( } (e/e c ) 1 -90° at u = 3.5) 

(2) A maximum low-frequency droop of -3dB ( |e/e c | >_ -3dB for w < Bw) 

and the form of the compensation (or the ratio of Tp-|/T g) must mini- 
mize resonant peak l 0 / 0 c l max * 

The relationship between the open-loop transfer function and the 
closed-loop transfer function has already been stated in defining 
terminology. This relationship is characteristic of unity feedback 
systems, such as the one of Figure 2.4. Designing a (pilot) controller 
for such a system, in this analysis, was greatly facilitated by the 
use of the Nichols chart. 

The Nichols chart, shown in Figure 2.6 with the Neal and Smith 
standards of performance, is a graph illustrating lines of constant 
closed-loop amplitude and phase on a grid of open-loop amplitude 
versus phase. Simply plotting the open-loop (e/e ) amplitude versus 
phase on a Nichols chart gives instantaneous information regarding 
closed-loop performance. The sample open-loop curve, depicted in 
Figure 2.6, is representative of a system correctly compensated to 
the desired droop, bandwidth and a closed-loop amplitude j e/© c | rough- 
ly equal to 0 dB at the bandwidth frequency. With this template for 
low frequency performance, finding the optimal compensation, that is 
the compensation meeting Neal and Smith's performance standards and 
minimizing resonance peak l 0 / 0 c l max 1S the remaining task. 
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Figure 2.6 Nichols Chart Showing Performance 
Standards and a Sample Amplitude- 
Phase Curve 
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The effect of adding the simplest form of compensations that is 
Kp» the controller gain, slides the amplitude-phase curve vertically 
on the Nichols chart. Adding the frequency dependent lead-lag compen- 
sation is not so simple. 

Neal and Smith's argument for their optimal lead-lag compensation 
is based on two observations; on the Nichols chart, resonance occurs 
at the point where the amplitude-phase curve is tangent to the loci of 
constant |e/e |. And, an important factor influencing the magnitude 

V 

of the closed-loop resonance is the slope of the amplitude-phase curve 
in the vicinity of Bw. Noting the trends and limitations of the 
lead-lag network to control this slope, Neal and Smith developed an 
overlay, containing the amplitude-phase curves for the "optimum" pilot 
compensation. This overlay, shown in Figure 2.7, would produce a 
slope at a) = Bw conducive to minimizing closed-loop resonance. To 
illustrate the use of this compensation overlay, consider the following 
' example . 

Given the Bode amplitude and phase characteristics of configura- 
tion 2G's pitch attitude response, |e(ju>)/F (jw) j and $(e(ju>)/F (ju>)) of 
Figure 2.8, find the pilot parameters that will meet the performance 
standards and minimize the system's oscillatory tendencies. 

The analysis begins by adding the pilot's time delay at some 
nominal K p (say 1.0). See Figure 2.8. 

(e/e e )* = 1.0 e“°- 3s (e/F s ) or 

* (e/e e j* = } (e/F s ) + 57.3(-0.3 w ) 
and 

|e/e e |*> | o/F s | 


(2.3) 
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Figure 2.7 Overlay of Amplitude-Phase 
Curves for "Optimum" Pilot 
Compensation 






(0 ~ RAD/SEC 


Figure 2.8 Open-Loop Bode Characteristics for Configuration 2G 
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k k 

Plotting | e/e | versus } (e/e e ) » shown in Figure 2.9, on the Nichols 

chart and for the moment, neglecting the vertical placement of the 

amplitude-phase curve, it is obvious that at the desired bandwidth 

(3 rad/sec in this case), 40 degrees of lead must be added to obtain 

low frequency performance comparable to the amplitude-phase curve of 

* 

Figure 2.6. From the overlay, 40 degrees of lead at m = 3.0 rad/sec 

translates into T pl u = .85 or T p1 = .28. Setting T pl , the overlay's 

origin is then centered both horizontally and vertically on a number 

* 

of points on the e/e e amplitude-phase curve. The compensation is 

added graphically by locating the point of the compensation amplitude- 

phase curve corresponding to the value of 0 . 28 a), where u is the fre- 

* 

quency corresponding to the point of e/e e amplitude-phase curve 
positioned at the overlay's origin. The compensated curve, depicted 
as the dashed line in Figure 2.9, must now be positioned vertically 
to meet the performance standards. 

Adding a gain- of 2 dB will shift the compensated curve up to the 
desired position shown in Figure 2.10. The resulting resonance occurs 
at co = 4.0 rad/sec and has a magnitude of 7 dB. A few attempts will 
usually be needed to obtain the compensation that will produce minimum 
resonance. Neal and Smith found that a lead compensation of 35° at 
id = Bw was suitable to produce a resonant peak of 6 dB, as opposed to 
the example's first attempt that used 40° of lead compensation at m = Bw 

for l e/e cLax = 7 dB - 

In Figure 2.11, Neal and Smith's. ultimate results are shown that 
relate pilot rating with the resulting pilot compensation and magni- 
tude of resonance peak. The diagram divides the pilot's rating into 
three levels of handling qualities. 
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Figure 2.10 Gain-Adjusted, Compensated Amplitude-Phase 
Curve for Configuration 2G 




PILOT COHI’ENSAI ION (nnc.) 


PILOT RATING 
O 1-3.5 
A 3-5 -6.5 
□ 6.5 - 10 


Figure 2.11 Neal -Smith Results 
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Cooper-Harper 


Level 

1 

1.0 - 

3.5 

good 

Level 

2 

3.5 - 

6.5 

fair 

Level 

3 

6.5 - 

10.0 

poor 


The dynamics of the configurations represented in Figure 2.11 can be 
found in Table 2.1. (More were evaluated in Ref. 1) 

Overall, the results of this analysis were encouraging, however, 
problems inherent to pilot parameter selection made this method 
cumbersome. 

One of the biggest problems centered on bandwidth selection. In 

the experiment, some of the aircraft were flown at different flight 

conditions (i.e. slower flight speed) and a different bandwidth was 

used to create the needed correlation. Such was the case tn the 

above example with bandwidth set at 3.0 rad/sec. Bandwidth is also 

dependent on task and how aggressively the pilot feels he must be to 

satisfy the task's objectives. In their analysis, Neal and Smith 

said, "Bw was determined by trying a few values of Bw in the evaluation 

of a cross section of. configurations until the resulting values of 

| e/e | correlated qualitatively with pilot comments concerning PIO 
c max 

tendencies." This fact makes the analysis somewhat impractical as a 
predictive tool if a priori knowledge of bandwidth is required. In 
addition, the determination of a suitable pilot representation has 
always been difficult. Thus an alternate method is desired. 

This alternate method will evolve from the optimal control model 
of the next chapter. The following chapters will approach the Neal- 
Smith method using a better model of the human controller. 
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CHAPTER 3 

THE OPTIMAL CONTROL MODEL 


f2l 

In 1970, Kleinman, Baron, and Levinson 1 - J published a mathematical 
model of human response using optimal -control and estimation theory. 
This optimal-control model (OCM) of the pilot assumes that the well- 
trained, well-motivated human operator chooses his control input Up 
subject to human limitations such that the following objective function 
is minimized 

0 = E dim i (y'Qy + ru 2 + g u 2 )dt} (3.1) 

P T*» T Jo P P 

where g is selected to obtain a chosen neuromuscular lag time constant 
The pilot's input, the solution to the optimal control problem 
as stated, is expressed as 


u„ + 
p m 


with y, the best state estimate conditioned on delayed, noisy observa- 
★ 

tions, and i , the optimal control gains, and v^, the motor noise, 
qualitatively illustrated in the overall pilot model of Figure 3.1. 

The model's individual components (i.e. , state estimator, predictor, 
and control law) will be discussed in the coming sections, of this 
chapter. 

To aid readers unfamiliar with the OCM, Chapter 3 is divided 
into three sections. The first presents Kleinman's solution for the 
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optimal control of a linear system with time delay and observation 
noise, a useful forerunner to the development of the OCM. The second 
section extends the problem of the first section, incorporating motor 
noise and neuromuscular lag, thereby establishing the structure of 
the OCM. Section 3, utilizing the linear time-invariant equations of 
the previous sections, forms the OCM's transfer function for the human 
pilot model, an important relationship needed in the Neal and Smith 
analysis. 

3. 1 Optimal Control of a Linear System with Time Delay and Measurement 

Noise 

An important problem, basic to the development of the OCM, is the 
general problem of identifying a controller that will minimize a qua- 
dratic cost when measurements consist of a linear combination of 

m 

corrupted, delayed states. Kleinman 1 - J has shown for such problems 
the optimal state estimator is generated by cascading a Kalman Filter 
and a least-mean-square predictor. 

The prescribed problem deals specifically with a given time 
invariant system presented in the following state space form. 


x(t) = Ax(t) + Bu(t) + w(t) 

(3.3) 

y(t) - Cx(t--r) + v(t-T ) 

(3.4) 


The usual conditions of (A,B) and {A, Cl being stabilizable and 
detectable pairs are assumed. Also, w(t) and v(t) are considered 
stationary Gaussian white noise vectors with auto-covariance matrices. 


E{w(t) w'(o)} = W <5 (t-a) 
E{v(t) v 1 (a) } = V 6 (t-a) 


(3.5) 
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where W, V > 0. The time delay, t >_ 0, is fixed in Eq. (3.4). More- 
over, the system's initial conditions are assumed to be equal to zero. 

The problem's objective is to find the non-anticipative control 
u that minimizes the cost 


J(u) 


lim ~ 

T-Kx> 1 



[x'(t-x) Qx(t-x) 


+ u'(t-x) R u(t-x)]dt} , (3.6) 


conditioned on the observed variable y(a), a <_ t, where R > 0 and 
the pair {A, v^Q} is completely- observable, and where the delayed 
state x(t-x) is generated by 


x(t-x) = Ax(t-x) + Bu(t-x) + w(t-x) 


(3.7) 


The solution is obtained by first defining the least-mean-square 
estimate of x(t-x) as 


x(t-x) = E{x(t-x)|-y(a), a < t} (3.8) 

A 

The estimate x(t-x) may be computed directly from y, using a Kalman 
Filter modified to include the deterministic input u(t), 

x(t-x) = Ax(t-x) + z(t-x)C' V -1 [y(t) - Cx(t-x)J 

+ Bu(t-i) (3.9) 

x(o) = 0 

where t(t) is the covariance of the Kalman Filter estimation error, 
e(t) = x(t) - x(t). z (t ) is also the positive definite solution of 

Z(t) = AE(t) + Z (t ) A ' + W - E(t)C' V” 1 C z(t) 
z(o) = 0 


(3.10) 
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As time tends to infinity, z(t) approaches the constant, steady-state 
solution, z, a unique positive definite matrix. Substituting z for 
z (t~T ) in Eq. (3.9) produces the desired steady-state Kalman Filter. 

Unfortunately, given the current observation, y(t), the Kalman 

A 

Filter produces only delayed estimate x(t—r) while the system, with 
control, is at the current state x(t). In order to minimize J, the 

A A 

optimal control must be generated from x(t--r), not x(t) as in the 
standard linear, quadratic, Gaussian (LQG) optimal control approach. 
This dilemma is resolved by the development of a least-mean-square 
predictor capable of generating an estimate of x(t) from the delayed 
estimate x(t-x). The advantage of obtaining the predicted state 
reduces the problem to one equivalent to the well-known LQG problem 
using a modified, but equivalent cost function. 

Two basic concepts with parallel interpretations in the Kalman 
Filter and the least-mean-squared predictor will permit the needed 
modification of the cost functional. First, the least-mean-square 
estimator (predictor) provides an orthogonal projection of x(t) 

(x(t)) onto the subspace of the observed variable y(x(. t-x)), leading 

A 

to an extremely useful property; the estimate x (prediction y) is 
orthogonal to its error e(e p ) as shown in Fig. 3.2a(3.2b). The 
second important task, establishing the independence of the estima- 
tion (prediction) error from the deterministic input u, will become 
evident upon finding the differential equations generating the esti- 
mation (prediction) error. 

The solution proceeds by first investigating the estimation error, 
i(t). To generate e(t), substitute Eq. (3.4) into Eq. (3.9). 



X(t-x) 



Figure 3.2a Estimator Orthogonally Projects the Delayed 
State onto the Subspace of Observations 



Figure 3.2b Predictor Orthogonally Projects the Current 

Estimate onto the Subspace of Delayed Estimates 
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x (t-T ) = Ax(t-x) + l C'V^CCxCt-x) 
-x(t-x)] + Bu(t-x) + 5 C'V~"*v(t-x) 


(3.11) 


Since all time-dependent variables are at the same point in time, set- 
ting t = t-x will provide an equivalent form of Eq. (3.11). Then,, 
noting that the error rate may be expressed as 

e(t) = x(t) - x(t) , (3.12) 


substitute Eq. (3.3) and the equivalent form of Eq. (3.11) into 


Eq. (3.12) 


e(t) = [A - zC'V“ l C]5(t) - l C'V” 1 v(t) 
+ w(t) 


(3.13) 


Clearly, the error is independent of the input u(t) . Eq. (3.13) will 
further aid in making the first of two modifications to the cost, J. 

The second modification will follow the development of the predictor, 
proceeding roughly along the same line of reasoning as the first. 

To modify the cost, J, start by rewriting the first term of Eq.(3.6) 


as 

E{x' (t-x) Qx(t-x)} = E{e' (t-x) Qe(t-x) } 
+ E{ x ' (t-x) Qx(t-x)} 


(3.14) 


A A 

since E{ x 1 (t-x) e(t-x)} = 0 when x(t-x) is a least-mean-square estimate. 
Substituting Eq. (3.14) into Eq. (3.6) transforms the original cost 
function into 


J(u) = lim 1 E{ 
T-h» 


f T 

i' (t-x) Qe(t-x)dt} + (G) 


(3.15) 
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where 


J, (u) = Tim Jr E{ 
1 T-x” 


J 


[x * ( t”T ) Qx(t-x) + u * (t-x) Ru(t-x)]dt} (3.16) 


From previous results, the error is independent of u(t), making 
the first term of Eq. (3.15) unaffected by the choice of u. Hence, the 
original problem can be equivalently restated as finding the control 
input u (t ) that minimizes J-|(u), with x(t-x) generated by 

x(t-x) = Ax(t-x) + Bu(t-x) 

+ fC , V” 1 [Ce(t-x) + v(t-x)] (3.17) 


in the steady state. 

Wonham^ has shown that the process, fc* V -1 [Ci(t-x) + v(t-x)], 
can be represented as a white noise process w(t-x) whose autocovariance 
matrix is given by 


E{w(t)w‘ (o ) } = Z-C'V‘ 1 CZ«(t-o) 
= W5(t-a) 


(3.18) 


This equivalent process simplifies the analysis of x(t-x) by restating 
Eq. (3.17) as 

x(t-x) = Ax(t-x) + Bu(t-x) + w(t-x) (3.19) 

Note that Eq. (3.19), representing the new system to be regulated, 

A 

governs only the delayed estimate, x(t-x). Now, the original problem 
is reduced to finding the nonanticipative u (t ) that will minimize J-j(u). 
The solution will be realized by first finding the predicted state y(t) 
based on the output. 
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y(o) = (x(o-x) ; a <_ t} (3.20) 

Kleinman defined the least mean-square predicted state, y(t), as 

y(t) = E{ x ( t ) |y(o) , a < t} (3.21 ) 

conditioned on the output of the Kalman Filter. To generate y(t), 
start by rewriting Eq. (3.19) as 

y(t) = Ay(t) + Bu(t-x) + w(t-x) (3.22) 

Since the system is linear and u(t-x) is deterministic, the output of 

A 

the Kalman Filter, y(t) = x(t-x), may be decomposed into two parts: 
y u (t) s or that due to the deterministic input, and ?(t), or that 
generated by the process noise w(t-x). Splitting Eq. (3.22) apart 
according to input results in 



y u (t) = Ay u (t) + Bu(t-x) 

(3.23) 

and 




r(t) = A?(t) + w(t-x) 

(3.24) 

where 

y(t) = r(t) + y u (t) 

(3.25) 

and 



x(t) = r (t+x) + y u (t+x) 

(3.26) 


Note that the theoretical x(t) is actually an unattainable current 
state estimate; attainable only if either the time delay or the 
observation noise is absent. With Eq. (3.26) and the fact that y^ is 
a deterministic vector, simplify the definition of the predicted state, 
Eq. (3.21), to 

y(t) = y u (t+x) + E{r(t+x)|y(o) , a <_ t} 


(3.27) 
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Eq. (3.24) shows the independence of r(t) from the deterministic y (t), 
automatically reducing the second term of Eq. (3.27) to E(r(t+x) |r(o) , 
a <_ t). To evaluate this expression further, write the solution of 
Eq. (3.24) as 

r(t+t) - e Ax r(t) + fi A(t+x CT ^w(cr-t)da . (3.28) 

't 

Remember, w(t) is a zero-mean white noise process, thus 

E{r(t+x) |r(cr) , a < t} = e Ar ?(t) , (3.29) 

thereby, simplifying the predicted state, y, to 

y(t) = y u (t+r) + e Ax r(t) (3.30) 

Analytically, a differential equation generating y would be pre- 
ferred. Differentiating Eq. (3.30) and then, substituting Eq. (3.23) 
and Eq. (3.24) with Eq. (3.25) into the expression tor y(t), gives the 
desired differential equation 

y(t) = Ay u (t+x) + Bu(t) + e Ax (Ar(t) + w(t-x)) (3.31) 

or 

y(t) = Ay ( t ) + Bu(t) + e Ax w(t-x) (3.32) 

with an equivalent representation obtained by substituting Eq. (3.25) 
into Eq. (3.30) or 

y(t) = c(t) + e Ax (x(t-x) - S(t-x)) (3.33) 

where 


l{t) = Af(t) + Bu (t) 
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Eqns. (3.33), formulated first by Kleinman^, govern the controller's 
prediction process. Later, Eq. (3.32) will be instrumental in develop- 
ing closed- form solutions for both the state covariance matrix and 
the total cost function. 

But to continue, a control u must be found to minimize J or 
equivalently, to minimize Note that so far, expressions have been 
developed to produce a state estimate at the current time, y(t). Now 
the cost (Eqn. 3.16) must be rewritten in terms of y. To begin, 
express 0^ as 

T 

0,(u) = lim y E{ [ [x'(t) Qx(.t) + u'(t) Ru(t)] dt} C3.34) 

1 ' J 0 

Paralleling the development of decompose the unattainable current 

A ^ 

estimate x(t) into its orthogonal components: y, the orthogonal pro- 

£ £ 

jection of x(t) onto the subspace of the delayed estimate x(t-x), and 

ip, the prediction error defined as 


ip(t) = x(t) - y(t ) 


(3.35) 


Using the same arguments cited in the estimation process, the first 
term of expands to 

Eix'Qx} = E{e'Qe } + E{y'Qy} (3.36) 

r r 

Upon investigation of Eq. (3.26) and Eq. (3.30), the prediction 
error, e p , may be rewritten as r(.t+ T ) - e AT r(t), where r(t+x) is 
given by Eq. (3.28) 


5 p (t> 


' t+T e A(t+x-c) 

t 


w(a-t) da 


(3.37) 
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Letting £ = t+T-a with d£ = -da. 


5 (t) = e A? w(t-i) d£ 

P n 


provides the means of evaluating E{ e p ' Qe p > . 


E{£p Qip } = tr(QE{i p ip}) 


= tr(Q 


P e AC W e A ' s d?) 


(3.38) 


(3.39) 


Observe that this covariance of the prediction error is also independent 
of u. Thus, J-j may be expressed as 


1 


rT 


T-m» 


J 1 = E{li.m j j (e p ’ Qip + y'Qy + u'Ru) dt > 


= tr (Q 


fT 


e A5 W e A '^ d 6 ) 


(3.40) 


+ E{lim “ 
T-*» 1 


fT 


(y'Qy + u'Ru) dt} 


And, since the first term of Eq. (3.40) is independent of u, finding 
a control to minimize J-|(u) is equivalent to finding a control to 
minimize 


J 2 (u) = Edirn j 

i ’ T-**> 


J 


(y'Qy + u'Ru) dt} 


(3.41) 


Finally, the problem is now reduced to the familiar LQG format 
with y governed by Eq. (3.32), or 


y(t) = Ay(t) + Bu(t) + w 2 (t) 



34 


where 

w 2 (t) = e AT w(t-t) (3.42) 

and 

W 2 = E{w 2 w 2 '} = e AT We A ' T . 

The solution now, is identical to the control u that will minimize 

r 3 i 

J 2 if all states were available for feedback. The solution L J is 

u* (t ) = -L*y(t) = "R~ ] B‘ Ky(t) (3.43) 


with K, the unique positive definite solution of the algebraic Ricatti 
matrix equation, 

0 = KA + A'K + Q - KBR" 1 B'K . (3.44) 

The resulting minimum cost J 2 is easily evaluated as 

J 2 (u) = tr(KW 2 ) = tr(K e Ax W e A ‘ x ) (.3.45) 

This expression, however, does not represent the total cost. 

To evaluate the total cost, we have 


and 


J(u) = lim ]r E{[ e'(t)Qi(t)dt} + J,(u) (3.46) 

T-*» 1 Jo 1 

J,( u ) = tr ( qJ T e Ac W e A ' ? dc) + d 2 (0) (3.47) 


Utilizing the previously defined relationships 


W = zC' V _1 Cz 


and 

z = E{e(t)i' (t) } as t-*» , 


(3.48) 
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we assemble the total cost 

J(u) = tr(Qz) + tr(Q 

+ tr(K e Ax zC'V’cz e A ' x ) 


f e A ^ SC’ V' _1 CZ e A ? dc) 


(3.49) 


.C3] 


or using the techniques of Appendix A, J(u) is expressible 1 - -* as 

fX Mu „A'e 


where 


J(u ) » tr(Q e e ^dc) + 

•*o 

tr(Ke Ax W e A ' T ) + tr(L e E L^) 


%, * At 

L e = L e At 


(3.50) 


Kleinman remarked that the total cost is composed of three elements, 
respectively, evolving from the prediction error, the dynamic distur- 
bance w(t), and the observation noise v(t). In each element, the 
effect of time delay is evident. 

To correlate results between the experiment and the model, state 

and output statistics are needed. These measures are attainable from 

the state covariance matrix. Using techniques created to find the 

total cost. Appendix B formulates the following closed-form expres- 

m 

sion J for the state covariance matrix 


E{x(t)x'(t)J = e Ax z e A ' x + 


fX 


AC ,, A 
e W e dc 


f°° /„Aa At - r i.,-l r - A't _A 1 c\. 

1 (e e EC V Ce e e )da 


(3.51) 



where 
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This section has summarized Kleinman's controller that will mini- 
mize a given quadratic objective function when the measurements consist 
of a linear combination of delayed states, corrupted by noise. Fur- 
thermore, the section concluded with the statement of closed form 
expressions for the total cost and the state covariance matrix, useful 
information in gauging a system's performance and a model's validity. 
The next section will extend the model's structure, incorporating the 
philosophy of the human controller to develop an optimal -control 
pilot model . 

3.2 The Optimal Control Pilot Model 

Obviously, several parallels exist between the controller of the 
previous section and the desired model of the human controller. In 
each, the plant and display dynamics are assumed to be accurately 
modelled by' the time invariant form 

x(t) = Ax(t) + bUp(t) + w(t) (3.52) 

But, in the pilot model, x(t) represents the vehicle states, Up(t) is 
the pilots input, and w(t) represents random external disturbances. 

The time delay, previously associated with the system output, is now 
internal to the controller. Hence, the pilot observes the following 
displayed information 

y(t) = Cx(t) (3.53) 

but in reality, he perceives 

y p (t) = Cx(t-x) + v (t-x ) 


(3.54) 
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a delayed, noisy replica of the system's output. Similar to the 
previous development, the pilot's estimation process may be represented 
by a Kalman Filter cascaded with a least mean-square predictor. 

Perhaps one of the biggest differences between the controller of 
Section 3.1 and the optimal human controller, however, is the addition 
of neuromuscular dynamics. But in general, the optimal human control- 
ler is a natural extension of the previous development. 

Consider the task-oriented objective function of the OCM, . 

J(u!) = lim X E{[ (x'Qx + ru^ + gu^} dt} (3.55) 

p T-**> 1 J o F p 


conditioned on the perceived y p (a), a <. t, with Q = diag {q-j , q 2 ... 
q n > ; q.. >_ 0, and r ^ 0 and g > 0, scalar constants. Expanding the 
objective function to minimize control rate automatically adds a 
first order lag (or "neuromuscular" dynamics) to the controller. 

And, since a one-to-one correspondence exists between g and t^, the 
researcher has the flexibility to select whatever neuromuscular time 
constant he desires, by simply varying the weighting on control rate. 

To accommodate the neuromotor dynamics or equivalently, the 
expanded cost functional , define a new (n+1) state vector, x'(t) = 

{x 1 (t ) , u p (t)}, generated by 


« 

x(t) = A Q x(t) + b Q ji(t) + w Q (t) 
y p (t) = C 0 x(t~r) + v(t-x) 

with 


(3.56) 



c 0 ' CC | o] 
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and with y(t) = u (t) and w q ’ ( t ) = (w'(t), 0 ) . 

The optimal control law, assuming full-state feedback, follows 
di recti y 

At) = -U(t) (3.57) 


with y(t), the best estimate of the current state given the condition 
of the observed measurements. Also we have (n+1) feedback gains, 
generated from 


SL 


1 


g b o K o 


(3.58) 


with K q , the unique positive definite matrix satisfying the (n+ 1 ) 
dimensional Ricatti equation 

AIK + K A + Q - K b b ‘K /g = 0 (3.59) 

00 0 0 M 0 0000 s 


Finally, Q q is the new weighting matrix, defined as 



(3.60) 


The expanded version of the full-state feedback control law 1 


[ 2 ] i; 


y*(t) ■ u p (t) = -i n+1 u p (t)-^ ^ y.(t) 


(3.61) 


This expression may be rewritten in terms of the neuromuscular time 
constant 

T N yt) + Up (t ) = -A* y(t) ; £* = (A*, 0) (3.62) 

1 * 

with x N = - — - and £. = 7 —— ; i = 1, 2, ... n. In the frequency 

n +1 1 n +1 

domain, the existence of the first order lag is evident from observing 
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Ms) = 


P"' ^s+l 


*_ 

V 


£ q y(s) 


(3.63) 


To reflect the pilot's imprecise control input, a Gaussian white 
noise v (refer to Figure 3.1) with covariance V is added to the 
commanded input, u , 

v 

T N u p (t) + U p ( t ) = u c (t) + v m (t) (3.64) 

★ — 

where u_(t) = y(t). This expression assumes that the control law 

and gains remain unchanged in the presence of this noise, and repre- 
sents now a sub-optimal controller. 

Fortunately, the addition of motor noise changes the basic 
controller structure very little from the previous development with 
only the augmented state vector x replacing x, and u c replacing the 
deterministic u. Incorporating Eq. (3.56) with Eq. (3.64), the 
modified state space representation follows as 


with 


x(t) = A 1 x(t) + b 1 u c (t) + w^t) 
y p (t) = C 1 x(t-r) + v(t-T); v ^ N(o, V) 


(3.65) 



and C-| = [C | 0] , (same as C Q ). 

The augmented noise vector w-l = (w'(t), ) has a covariance matrix 

‘ t N 


of the form 
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EC^ (t)w* (a)} = W 1 S(t-a) 


W 1 = 


w 1 

1 

o 


V 

0 

ITI 

t m 2 _ 


(3.66). 


Thus, based on the pilot's preceived observation, y p , the Kalman Filter 
generates the best estimate of x(t-T), or x (t—r) , from 


X (t~T ) = A] x(t~T ) + b^ u c (t“t) 

+ z -j C-j' V 1 [y p (t) - C-| x(t-r)] 

with the error covariance, Z-j, satisfying 

0 ■ A 1 ?i + 2-jA' + W 1 - Z 1 C 1 'V~ 1 C 1 Z 


(3.67) 


(3.68) 


As before, the predictor generates y, the least-mean-squared estimate 
of x(t) based upon the delayed estimate of x(t--r), or x(t--r) from 


A 1 t 


Y (t) = lit) + e Cx(t--c) - l(t-x)] 

i(t) = A 1 t(t) + b 1 u c (t) 


(3.69) 


And, using techniques of Appendix B, state covariance 1 J of x becomes 


C2] 


A, t Ai 


X = E{ x(t) x'(t)} = e 1 ^ e ]T + 


f T A, 5 


I s 1 E 

e 1 W ] e u dC 


+ f (e Aa e 1 e 1 e A ' CT ) 

* 


(3.70) 


da 


with A = A q - b Q £. Thus, 


E{x i /(t)} = X.. i = 1, 2, ... n 


(3.71) 
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E{yf(t)} = (C 1 X q)^. 1 = 1, 2, ... m (3.72) 

< 3 ' 73 > 


To finally complete the development of the pilot model, two addi- 
tional human limitations, observation thresholds and scanning behavior, 
must be included. Observation thresholds and shared attention allo- 
cation increase the effective observation noise, v. As stated before, 
the observation error v(t) is a zero mean Gaussian white noise process 

f5 1 

with covariance V. This covariance or V i , L J of the ith observed 
variable is modified to be 


f i N(a., 




(3.74) 


2 

with 0 ^ the variance of the observed variable and , the basic full 
attention noise-to-signal ratio for human perception of this variable. 
Scanning behavior is accounted for by including in the above rela- 
tion the parameter f. , the fraction of total attention alloted to the 
ith observed variable. And, the perceptual or indifference threshold 
level, a.j , influences the measurement noise covariance in the form of 
a dead-zone describing function, N(a.j, cu), with the following limits; 


1 N (cr-j , cu)| *1; (a. = 0, minimum variance of ith observed 


variable, V. = (J-) a .^) 

i T 4 » 


(3.75) 


|N(a^, ) | = 0; (a^ < , no preception of ith variable. 


V i 


0 
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When the signal's standard deviation, o. , is greater than the corres- 
ponding threshold level, the noise-to-signal ratio is increased by 
the magnitude of * 

Thus, with the structure of the optimal control model established. 
Chapter 3 concludes with a section devoted to finding the pilot's 
frequency response from the model. 

3.3 Pilot's Frequency Response 

Given the pilot's objective, his control actions are assumed to 
be governed by the linear, time invariant equations of the optimal 
controller presented in the previous section. The objective of this 
section is to represent the optimal control model in the frequency 
domain, obtaining a transfer function matrix, R, relating the pilot's 
observations y to his control output u p , or 

u (s) = H(s) y(s) 

Taking the Laplace transform of Eq. (3.69) yields 

v(s) = I(s) + e 1 V IST (x(s) - Its))] 

Collecting similar terms 

(Is-A, )t (Is-AJt 

e 1 y(s) = [e 1 - I] 5(s) 

+ x(s) 

Next, transforming the equation that generates |(t), Eqn. 

!(s) = -(sI-A^" 1 b 1 A e *y(s) 

Letting 

A = A 1 - 2 1 C^V" 1 C 1 , 


(3.76) 

(3.77) 

(3.78) 

(3.69) , yields 

(3.79) 
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the state estimator, from Eq. (3.67), is transformed to 


(Is-A) x(s) + b ] £ e "y(s) = E 1 C’V“ 1 y(s) 


(3.80) 


•o «9- C 

and where e has been factored from both sides substituting Eq. (3.79) 
into Eq. (3.78) yields 


x(s) = {e 


(sI-A^t (sI-AJt 


+ Ce 


1 


I] 


(3.81) 


y(s) 


the transfer matrix between the estimated state and the predicted state, 


5^. {e (sI ’ A i ) + re (8l ' A i )T . 


x(s) 


Ce 


I] 


• (sI-A,)" 1 b 1 £ e *}' 1 


(3.82) 


Substituting Eq. (3.80) into Eq. (3.81), creates the transfer matrix 
between the observation vector and the predicted state 


Z(c\ - (sI-A,)t (sI-A, )t 

ill) = [ (Is-A) {e 1 + [e 1 - I] 

y(s) 

• (sI-A-j ) -1 b^*} + b 1 * e T\c\ V ' 1 


(3.83) 


This expression can be rewritten as 


= C(sl-A) (e 

y(s) 


(sI-A-j ) 


(si -A, )x _i * 

[e 1 - I] (s I— A ] ) b 1 y 


+ (sI-A) + b-j yj _1 ! C j V 


(3.84) 
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or 

„ (sI-A, )t , 

» [(si- A) {[e 1 -I](sl-A 1 )“ 1 (sl-A 1 ) 

(sI-A, )t _i * 

+ [e 1 =13 (sI~A 1 ) 1 b 1 i i } (3.85) 


+ sI-A + b. t *]” 1 LC‘ V " 1 
or 

„ (sI-A -, ) t i 

- [ (sI-A) [e 1 - Ij ( si ~A ] )" {sI-A 1 

(3.86) 

+ £ g } + sI-A + b-j £ g ] ^ V ^ 


Setting 

~ * 

A - A-j - £ g and noting 

(3.87) 

(sI-A, )x , f-x (si -A. )a 

[. 1 - I] (sI-A.)' 1 - e 1 da 

J o 


establishes the general form of- the transfer matrix between the obser- 
vation vector and the predicted state, T(t). 


-f c \ - ft (sI-A , )a 

= [(sI-A) e 1 dc (sI-A) 
y(s) 'o 

+ sI-A + b ] t*]” 1 ^CjV" 1 


(3.88) 


The pilot transfer function H(s) considers v to be zero, consistent 

m 

with the definition of a transfer function. Thus 


t N “p (t) + “(/*> " - *e 


(3,89) 


is transformed to 
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Other forms of H(s) are also possible. Now, the pilot's frequency res- 
ponse may then be obtained simply by substituting s = jw in the expres- 
sion, above. 
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CHAPTER 4 

METHODOLOGY AND RESULTS 

Thus far, a decade of dust has been blown off two interesting 
developments. The first, recall, was a hypothesis correlating pilot 
opinion with elements of pilot compensation and closed-loop performance. 
Although early results verifying this hypothesis were encouraging, 
problems inherent to the classical model structure plagued the approach. 
Contrary to this situation, the OCM was frequently applied to many 
situations involving the human controller. In fact, the OCM was orig- 
inally viewed as a viable alternative to the classical model structure, 
minimizing many of the shortcomings of the classical method. 

Thus as the next step, in Chapter 4, we must first merge the OCM 
modelling procedure with the hypothesis and methodology of Neal and 
Smith to produce the desired alternate approach. Secondly, in Chapter 
4, we must utilize the new approach to develop the results for a number 
of configurations originally analyzed by Neal and Smith, and then 
compare these results. 

To logically interpret the Neal-Smith procedure via the OCM, 
Chapter 4 is divided into four sections, with the first containing a 
comparison of the two interpretations of tracking strategy. The 
second section, then, builds on the discussion of the first, providing 
a model of the tracking task. This second section also encompasses 
the identification of the OCM's parameters, vectors, and matrices 
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relevant to defining the task. The third section exercises the optimal 
solution of the problem as stated in Section 4.2 in that it uses the 
resulting pilot frequency response (defined as Eq. (3.91)) to duplicate 
the Neal and Smith methodology. Lastly, the fourth section presents 
the results and the proposed design criteria of the new approach, pro- 
viding in addition an interesting correlation between bandwidth and 
pilot rating. 

But first, consider the OCM's tracking strategy in comparison to 
that interpreted by Neal and Smith. 


4.1 Basic Hypothesis 

Surely, good tracking minimizes the error between the target's 
attitude and the aircraft's attitude. The addition of tracking error 
(e -e) to J results in an OCM control strategy that minimizes the 

c p 

mean squared value of error, which can be expressed as 


2 

°E 


■] r°° 

TT 


n - 


( j») f 


S (w) dw 
e c 


(4.1) 


where S n is the spectral density of the commanded signal. Minimizing 
^c 

the above expression may be interpreted as forcing the closed-loop 

frequency response (|— ) to tend to unity over the frequency range of 

e c 

the commanded signal. Unity corresponds to the performance attained 

by the perfect tracker with |J— f = OdB and ) (|-) = 0°. Thus, in terms 

c c 

of amplitude of the closed- loop frequency response, the OCM 

"automatically" minimizes droop and resonance peak. 

In fact, the OCM goes beyond Neal and Smith’s definition of a good 

tracker to create a more correct definition, incorporating the 

effects of the closed-loop phase } (|-) characteristics on low frequency 

0 _ 
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(uj £ Boj) performance. The early analysis was only interested in one 
aspect of closed-loop phase, and that was bandwidth. Unfortunately, 
two systems with the same bandwidth and droop characteristics will 
sometimes exhibit markedly different levels of low frequency tracking 
performance. 

Truly, the pilot is just as interested in minimizing the distance 

0 

between closed-loop phase ) (— -) and the zero degree datem (or the 

e c 

phase difference between command and output), as he is in minimizing 
droop (or differences in the magnitudes). Having one objective satis- 
fied without the other could result in systems exhibiting excessive 
lag, even in cases with acceptable bandwidth. Unlike Neal and Smith's 
pilot modeling concept, the OCM is concerned with both the low-frequency 

amplitude and the low-frequency phase of (— ) in minimizing tracking 

e c 

error. And as a result of the optimization algorithm, the OCM will 
"automatically" determine the bandwidth required to achieve the pilot’s 
objective within the abilities of the vehicle dynamics. 

In summary, Neal and Smith proposed that the pilot is trying to 
achieve good low frequency performance (a reasonable bandwidth with a 
minimum of low frequency droop) plus good high frequency stability 
( 1 0 1 e c I max as sma ^ as possible). This proposition is a frequency 
domain representation of the pilot's objective to minimize tracking 
error. In contrast, the OCM provides another frequency domain 
representation of the pilot's strategy, encompassing the objec- 
tives of the previous approach in that it produces a tracker that 
attempts to be ideal across the frequency range of the commanded 
signal. 
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4.2 Modeling the Task 

To produce the desired tracker, the OCM must include a model of 
the tracking task. Three key elements concerning the application of 
the pilot model must be established: 

(1) The pilot’s observations and objective function to be 
minimized. 

(2) The system's representation in a tracking task. 

(3) A definition of the command signal to be tracked. 

In this discussion, specific attention will be given to adapting the 
OCM transfer functions to the simplified compensatory tracking task 
model of Neal and Smith. But first, the appropriate objective function 
must be selected. 

The optimal control model’s control input is selected to minimize 
the following objective function 

y 

J = E{limi [ (y ' Qy + ru 2 + gu 2 )dt} , (4.2) 

^ T-*» ■’0 r F 

subject to human limitations. The weighting matrix, Q = diag [q. , q„, 

y i c. 

..., q m ] >_ 0 '(Qy = C’QC from Chapter 3) where m is the dimension of the 
observation vector y; the weightings on control and control rate, 
(scalars in this analysis) r _> 0 and g > 0; plus the elements of y must 
all be determined to quantify the task. 

Obviously, the most critical parameter is the tracking error E ; 
the difference between the commanded attitude e c and the aircraft's 
attitude e. Observation of attitude itself is also required if the 
task is one of pursuit rather than compensatory in nature. (A compen- 
satory task is defined such that only error is observed). In addition 
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to e and e s studies^ have shown that the human controller can also 
extract rate as well as position from a single displays thereby expand- 
ing y to 

y' ~ (e» e» e) (4.3) 

The next step in quantifying the pilot's control objective is 
selecting the cost function weightings. Fortunately, research has 
begun to shed some light on the critical task of weight selection. 

One study^ attempted to identify the weighting matrix Q by correlat- 
ing pilot opinion ratings, the objective cost 0^, and performance 
statistics with simulation results. The investigation concluded that 
over a wide range of tracking tasks and flight conditions the following 
weights on e» e and 

q £ = 16 , = 1 , r F =0 (4.4) 

would accurately reflect the pilot's control objectives. The weighting, 
along with zero weighting on e and e defines Q and r in the following 
analysis. It should be noted that this Q emphasizes the pilot's 
primary goal of minimizing error with some constraint on how fast the 
error may fluctuate. To complete the definition of J p , the weighting 
on control rate must be set. 

The weighting g on the control rate u is constrained by physio- 

r 

logical limits. These limits are linked with the neuromuscular dynamics 
associated with the human controller modeled as a first order lag. The 
associated lag time constant is expressed in the context of the 
pilot (model) control law. 
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T m U = -£■ Y - U + V 
N p e P 


m 


(4.5) 


For a given set of weights on y and Up (r = 0 usually), adjusting g 
in the cost function determines Finally, for aggressive control 
action, the lower limit on t n has been determined to be near 0.1 
seconds, based on experimental, man-machine data. 

The vehicle dynamics to be controlled must be represented by the 
linear time-invariant equations of motion: 


x(t ) = Ax(t) + BUp(t) + N(t) 


(4.6) 


To model the tracking task, the vehicle states must be augmented with 
the command signal states. The augmented system is structured as 
fol 1 ows : 



(4.7) 


•» • 

where the vehicle states are defined as x' = [e, e, ct, etc.], the 
command signal states x' = [e c> e c L and indicates the identity 
matrix of appropriate dimension. 

In this analysis the commanded attitude is generated by a second 
order filter driven with white noise, or 


e c + ,5 ®c + -25e c = - 25w(t) 


(4.8) 



52 


Table 4.1 Baseline pilot model 

Observation Vector, y ' = [e, e, e, e] 

Objective Function Weights, Q = [16, 1, 0, 0] 

y i i 

R e ■ ■ 0 
F s 

Observation Thresholds, T - T = 0.05 deg. 

£ 0 

T. = T, - 0.18 deg. /sec. 

E 0 

Observation Noise Ratio, = =20 db 

Fractional Attention, f. = 0.5 all observed 

variables 

Observation Delay, t = 0.2 sec. 

Neuromuscular Lag, = 0.1 sec. 

Motor Noise Variances, -25 dB 
Control Input, F s (stick force) 

where w ~ N(0-» 64). This commanded signal approximates the discrete 

tracking experiment performed in the Neal and Smith investigation. 

The statistics on e and e : 

c c 

o Q ^ - 16deg 2 , a- Q ^ - 4 deg 2 /sec^ (4.9) 

c c 

indicate a reasonable, yet sufficiently challenging task to test pitch 
attitude tracking. Defining the commanded signal completes the objec- 
tives of this section. Table [4.1] summarizes the resulting pilot 
model parameters. 
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4.3 Analysis Technique 

The discussion turns now to the acquisition of those parameters 
required for the analysis technique. Of paramount importance is the 
ability to obtain a frequency domain representation of a controller 
developed in the time domain. 

Moreover, producing the system's closed-loop frequency response 
requires knowledge of both the pilot's transfer function matrix, 

H (>), and the aircraft's transfer function, H (jo)). Using the fol- 

p a 

lowing expression 


H a (ju>) = 


L [j5} = C(jwI ■ A veh ) ~ 1 b 


veh 


(4.10) 


with C = [1 0 0 ... 0], provides the plant's frequency response 
at selected values of to. And from Eq. (3.91), the pilot's frequency 
response H p (ja)) is obtained at each frequency. 

To calculate the closed-loop frequency response, consider now the 
pilots control law resulting from the problem formulation of the prev- 
ious chapter. By expanding the coherent part (ignoring motor noise) 
of pilot control in the frequency domain or 


Up(s) = H £ (s) e(s) + H £ (s) e(s) 
+ H 0 (s) e(s) + H^(s) e(s) , 


(4.11) 


the four dynamic components of R p are revealed. The pilot's input may 
be rewritten as 


u p (s) = CH £ (s) + s H^(s)] e(s) 
+ [H fl (s) + s H* (s)] e(s) 


(4.12) 
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where the bracketed terms are the true transfer functions relating 
tracking error and attitude angle to pilot input, respectively. Defin- 
ing the aircraft attitude transfer function as 

e(s) » H a (s) u (s) 

and (4.13) 

e(s) = © c (s) - © (s) , 

the desired closed loop transfer function is simply 




H a (s)[H + sH-] 

r^Hriiy[T^ 


(4.14) 


8 

A block diagram of this j~ transfer function is presented in Figure 
[4.1]. C 

The compensatory tracking model used by Neal and Smith, however, 
did not consider the inner loop (H„ + H“s)» even though the pilot 
monitored both error and attitude (i.e. pursuit task) in their experi- 
ment. To be consistent with the Neal -Smith model, make the following 
approximation; assume that the attitude's contribution to the pilot's 
compensation, after obtaining the complete model, is small. Or, the 
pilot's control input is approximately 


u (s) = (H (s) + s H* (s)) e(s) (4.15) 

pc e 

with H £ and IT found with attitude observed by the pilot, as simulated. 
The resulting approximate closed-loop transfer function is, of course 


e (s ) ~ H a 

6 ^ S ' 1 + H (s) H (s) 

a p 


(4.16) 


identical to the Neal and Smith compensatory tracking model. 
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Additionally, one final difference should be noted. Unlike the 
Neal -Smith pilot strategy, the OCM's control strategy is dependent 
upon three additional stochastic inputs: the command process e , the 

v 

motor noise process, and the observation noise process. Recall that 
due to the first, the pilot transfer vector H p (s) produces a closed- 
loop strategy that attempts to be ideal across the frequency range of 
e . Whereas the motor noise and observation noise, ignored by Neal 
and Smith by their not including any pilot remnant, affect the OCM by 
producing a control strategy designed to limit their effect. However, 
as will be shown, the effects of pilot remnant was negligible in obtain- 
ing meaningful closed-loop, steady-state results. 

To relate frequency domain characteristics to time domain charac- 
teristics, one approach consists of constructing the spectral densities 
of the system's variables 6 , e, u , and e. The area under the spec- 

v* P 

tral density S is related to the respective variances cr 2 by the 

A A 

relation 




S x (») 


doi 


(4.17) 


if x is a zero mean process. The perturbation variables e c , e, u p and 

e are zero mean process, so integrating Eq. (4.17) will yield the system 
2 2 2 2 

variances o Q , a , a , and <?„. These variances may then be compared 
0 c u p 

to their counterparts, obtained directly from the OCM's state covariance 
to see what effect neglecting pilot remnant and attitude feedback have 
on evaluating closed-loop performance. 

One method of calculating the needed spectral densities, assuming 
e £ as the only closed-loop system input (i.e. ignoring remnant), pro- 


ceeds as follows: 
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( 


S W U) - °l (4-18) 

S 0 (u.) = |H, (jm) | 2 S w (u,) (4.19) 

c 

S t U) - ||- (j»)| 2 S e („) (4.20) 

c c 

S U) = |~^ (jaj)j^ S (us) (4.21) 

Up e E 

s («) = if- U )| 2 S u ( u ) (4.22) 

P P 

o 

where o ^ is the intensity of the white noise driving the e c process 
with H-j(s) the shaping filter's transfer function. And in Eq. (4.20), 
the transfer function relating attitude error to command signal is 
obtained from 


fr (jto) = 1 + H Ail) H (j«T (4,23) 

C G p 

Once the spectral densities are ev.aluated over a sufficient band ( w ), 
the integration can be performed graphically to obtain the desired 
variances. A sample of these variances and their OCM-derived counter- 
parts are presented in Table [4.2] for configuration 2A. 

Table 4.2 RMS Comparison for configuration 2A 

Reduced System Actual (OCM) 


° e (deg) 

3.943 

4.000 

(deg) 

0.824 

0.808 

crp (lbs) 

2.289 

2.496 

r s 



o 0 (deg) 

3.670 

3.840 
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Surprisingly, the effect of cancelling the inner attitude loop 
and the motor and observation noises made little impact on the system's 
variances. Thus, the simpler closed-loop structure is a close approxi- 
mation of the OCM's closed-loop structure. Conversely, the OCM's 
format is now a valid model for the Neal and Smith "pilot-in-the-loop 
analysis". It remains to identify, the procedure and the resulting 
parameters deemed critical to pilot/vehicle analysis. 

The procedure begins by considering the output of the frequency 
analysis in a computer package for pilot-model analysis, or PXREP^-L 
PIREP may be used to calculate the frequency domain characteris- 
tics (Bode plots) of both the open-loop OCM pilot, Hp(jw), and the 
open-loop vehicle, H (juj), and these are determined in terms of 

d 

amplitude (in dB) and phase (in deg) for a selected set of input 
frequencies. Thirty-one points, listed in Table 4.3, along the fre- 
quency scale were judiciously chosen to provide an accurate represen- 
tation of the frequency response an a logarithmic scale. The Bode-plot 


Table 4.3 Selected Frequencies 


no. 

* 

Frequency 

no. 

* 

Frequency 

no. 

* 

Frequency 



1 * 

0.060 

11 

2 

0.130 

12 

3 

0.250 

13 

4 

0.500 

14 

5 

1.000 

15 

6 

1.500 

16 

7 

2.000 

17 

8 

2.178 

18 

9 

2.372 

19 

10 

2.583 

20 


2.813 

21 

6.596 

3.063 

22 

7.183 

3.335 

23 

7.822 

3.632 

24 

8.518 

3.955 

25 

9.276 

4.307 

26 

10.1 00 

4.690 

27 

11.000 

5.108 

28 

16.000 

5.562 

29 

22.000 

6.057 

30 

32.000 


31 

40.0 


*(in rad/sec) 
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format of H,(ju>) and H (jw), corresponding to each o> listed, allowed 
a p 

easy calculation of the open-loop pilot/vehicle system 


i6 


□ (dto) ! = |H (jw)| + |H (jw) | 

e e in dB a in dB p in dB 


i (f^ (j»)) - * (HgCjuj) + * (h p (j«)o 


(4.24) 


Unfortunately, to find the closed-loop frequency response more 

care must be given in selecting the frequencies w, since important 

details (i.e. J— — | ) can be hidden between sample points. Clearly 

e e max 

avoiding the uneconomical solution of the OCM generating more points, 

this analysis relied on a cubic-spline interpolation of the two smooth 

open-loop (— ( jto) ) curves to generate the additional closed-loop 
e e 

points. 

Once the interpolation procedure has boosted the total number of 
open-loop points to 200, these points were then translated to their 
complex number equivalents. The closed-loop frequency response is 
obtained simply by 


(j«) - 


1 + 


(jw) 

■ (jti)) 


(4.25) 


for each interpolated value of — . This expression produces a sequence 

6 e 

of 200 complex numbers to be translated into closed-loop Bode plots, 
or amplitude and phase characteristics. In this way, bandwidth, droop 
and resonant peak can be accurately measured and displayed. Further- 
more, the same cubic-spline interpolation scheme is applied to Hp(joj) 
to obtain information regarding pilot compensation. As an example. 
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consider Figures (4.2 and 4.3), displaying results obtained from the 
analysis of configuration 2D. 

Bandwidth, recall, is defined as the frequency at which the closed- 
loop phase ^ ( ®/ 6 C ) is ~90°» Unlike the Neal and Smith study, bandwidth 
is now a variable, dependent on task, vehicle, and human factors. 
Clearly, neuromuscular lag x N effects all four elements of the pilot 
transfer vector H p (s ) : H £ (s) , Fb(s), H Q (s) , and H^(s) . Although x^'s 

effect on the pilot's characteristics is self-evident, it is the not- 
so-self-evident effect on closed-loop bandwidth (speed of response) 
that is of interest. As x^ increases, the closed-loop bandwidth 
decreases. Therefore, "relaxed" pilot behavior, or large x^» is asso- 
ciated with a closed-loop system exhibiting slow response characteris- 
tics. Conversely, aggressive pilot behavior, or a low x^» produces a 
higher bandwidth, producing a more responsive and more aggressive 
pilot/aircraft combination. Since, then, the minimum x^ is usually 
accepted to be &. 1 -sec for aggressive tracking, setting this value in 
the OCM determines the maximum achievable bandwidth for the system. 

The second measure is the pilot phase compensation. The total 
pilot phase compensation from the OCM is the phase angle of the pilot's 
frequency response evaluated at the system bandwidth frequency (u = Bw). 
This compensation, however, includes the effects of neuromuscular 
lag x N and the perceptual time delay t. These effects may be 
corrected for via the following expression 

}p C = ^ 0 CI Vbw + 57,3 T * Bw + • Bw) 


(4.26) 
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where } pc corresponds to the Neal and Smith's interpretation of pilot 

compensation. For the purpose of correlation, Neal and Smith could 

have included their (constant) effective time delay as part of the 

pilot compensation. And since their bandwidth was fixed, this would 

simply slide the phase compensation scale (see Fig. 2.11) lower by a 

fixed angle for all aircraft configurations. 

The last measure, magnitude of resonance peak, | is available 

° c max 

from the closed-loop Bode plot, and the next section will explore it 
further. Hence all quantities are available through the OCM modeling 
process presented previously. 

4.4 Results from the Methodology 

Initial application of the method, discussed thus far, reveals 
the following characteristics of the OCM in evaluating the tracking 
task. 

1) The closed-loop system bandwidth varies with vehicle, 
task, and human factors. 

2) The (frequency response) droop varies with vehicle, task, 
and human factors. 

3) Given a stabilizable and detectable system where (A, /C'QC) 
is observable, the OCM will always produce a stable solution. 

4) Without correction, the resonance peak's magnitude of the 
OCM could not be correlated with PIO tendencies. 

At first glance, item number four would appear to be disastrous, 
especially since Neal and Smith correlated magnitude of resonance 

a 

peak ||- j with oscillatory tendencies. But given statement (3), 

°c max 

the absence of a significant peak is not totally unexpected. For 
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instance, given a configuration that is considered PIO prone ( 1 G) » 
the OCM will still produce a stable solution. A PIO condition will 
not be observed in the OCM's frequency response, since PIO tendencies, 
are by definition, unstable closed-loop solutions. 

The severe PIO prone condition, while not being predominant in 

A 

|— j , can be observed in the bandwidth frequency the pilot must 
0 c max 

settle for to obtain a stable system. Consider the definition given 
with PIO rating no. 4: 

Oscillations tend to develop when pilot initiates 
abrupt manuevers or attempts tight control. Pilot must 
reduce gain or abandon task to recover. 

Typically, the pilot must "ease off," or fly the aircraft less aggres- 
sively, to avoid hazardous oscillatory tendencies. 

Application of the method to several aircraft configurations 
evaluated by Neal and Smith resulted in bandwidth/pilot rating results 
shown in Figure [4.4]. These results reveal a trend of degraded pilot 
opinion with decreased closed-loop bandwidth, particularly where 
Bw _< 3 rad/sec in this task. Pilot comments mention an inability to 
track without severe PIO problems in configurations 1G, IF, 21, and 
2G, in support of the above results. Pilots also complained that these 
aircraft were "real sleepers", that is, they had large initial response 
delays, another indication of insufficient' bandwidth. 

The question of how to expose poor handling when a sufficient 

bandwidth is present is answered by the results shown in Figure [4.5], 
in which pilot rating is shown to depend on closed-loop resonance 
and pilot's phase compensation. But obtaining these results requires 



Pilot Rating (Cooper-Harper) 
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’ RATING/BANDWIDTH 
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2.5 3.0 3.5 4.0 

Closed-Loop Bandwidth (rad/sec) 


Figure 4.4 Pilot Rating/Bandwidth Correlation 
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discussion. With sufficient closed-loop bandwidth, large time delays 
of the initial responses are no longer present. The problem, which 
incidentally is evident in the rms tracking errors, is rooted in the 
trade off between errors due to low-frequency versus high-frequency 
performance. Generally, when faced with an aircraft exhibiting some 
PIO tendencies, the pilot will “back off" and sacrifice low frequency 
performance to minimize rms error due to any excessive resonance in 
the system. This statement is justified by correlating maximum low- 
frequency "droop" with the pilot's comments (Refer to Tables 4.4, 4.5, 
4.6). Upon comparing cases with neighboring bandwidth frequencies, 
the ones found to exhibit a lower droop automatically had higher error 
rms values and- pilot comments indicating some overshoot and PIO problems. 
This "delicate" strategy of avoiding lightly damped oscillation (or 
PIO's) will always be the result obtained from the OCM due to the 
guaranteed stability of this optimal solution -- or it will always use 
the "best" piloting strategy. Alternatively, one could argue that 
PIO's are the results of a sub-optimal piloting strategy, and in 
particular, this usually means that the pilot's "gain" is too high 
(above the "optimal"). 

On the hypothesis that the optimal (OCM) pilot is sacrificing low 
frequency performance, suppose an additional gain is added in the 
"forward path" for example, to raise the closed-loop droop to try to 
achieve a higher level of tracking performance. Typically, the droop 
of the configurations analyzed, ranged from -.3 to -1.0 dB. Adjusting 
the additional forward path gain to achieve 
|-|— [ > -.6 dB for a) <_ Bw 


(4.27) 



Table 4.4 Summary of Results 
8 Basic Short-Peri 



mm 

Bandwidth 

Droop 

(dB) 

Conf. 

■ 

(rad/sec) 





ID 

3-5 

3.267 

-.4359 

2D 

2.5 

3.675 

-.5416 

3A 

4-5 

3.472 

-.6543 

4A 

5.5 

3.700 

-.8324 

5A 

5-7 

3.403 

-.9909 

6C 

4.0 

3.322 

-.4172 

7C 

1.5-4 

3.619 

-.4272 


8A 


4-5 


3.513 


-.4690 


; Obtained for the 
iod Configurations 


ifi 

c max 
(dB) 

QCM ) 
(deg) 

* 

pc 

(deg) 

a 

(deg) 





1.834 

- 6.010 

+49.52 

.7250 

1.244 

-55.61 

+ 6.68 

.7226 

.6765 

-87.73 

-28.79 

.7850 

10.17 

-73.07 

-10.36 

.8714 

18.21 

-85.59 

-27.80 

.9511 

1.250 

-22.44 

+34.01 

.7244 

.7662 

-63.58 

- 2.21 

.6828 


.6460 


-85.26 


-25.64 


.6968 

























Table 4.6 Summary of Results 
Configurations of 


t 

Bandwidth 

D 

g 

(rad/sec) 



2A 

4.5 

3.778 

-.7581 

2B 

4-6 

3.320 

-.8644 

2C 

3.0 

3.783 

-.5898 

2D 

2.5 

3.675 

-.5416 

2E 

4.0 

3.369 

-.6024 

2F 

3.0 

3. 201 

-.6045 

2G 

7.0 

2.854 

-.7423 

2H 

5-6 

2.998 

-.5282 

21 

8.0 

2.673 

-.6639 

2J 

6.0 

2.806 

-.0498 


i Obtained for 
Group 2 


ifi 

c max 
(dB) 

OCM ) 
(deg) 

^pc 

(deg) 

°e 

(deg) 





4.967 

-73.82 

- 9.83 

.8081 

11.37 

-64.72 

- 8.31 

.9150 

1.200 

-70.31 

- 6.24 

.7335 

1.244 

-55.61 

+ 6.68 

.7226 

3.278 

-45.69 

+11.54 

.7960 

3.901 

-32.95 

+21.48 

.8231 

9.250 

-25.67 

+22.97 

.9513 

2.504 

-13.87 

+37.18 

.8391 

6.360 

-6.754 

+38.84 

.9768 


3.876 


7.010 


+54.84 


.8617 
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C 


produced resonant peaks comparable to those In Neal -Smith and therefore 
exposed those PIO prone configurations with this parameter. This 
procedure may sound reminiscent of the original approach, but only 
one degree of freedom exists -- that of "DC" gain adjustment. This 
was accomplished as an integral part of the computer-based analysis 
in the following way. 

1) Scan the magnitude of the closed- loop droop for minimum 

l! — -| ; 0 <u) .< Bw for w . (frequency at the droop) 
o min min 

c _ 

U)=tO . 

min 

A 

2) At a) : record the open-loop — (s) pilot/vehicle frequency 

response as the complex number a + ig. 

3) Find additional pilot gain K a to produce -.6 dB droop 

at to . by 
min J 


K a = 


B + A 2 - 4AC 


2A 


(4.28) 


where 

A = (1 - (y) 2 )(ct 2 + B 2 ) 

B = -2( y ) 2 
C - -(y) 2 
Y = 0.9441 

In dB K = 20 log (K) 

a a 

0 

4) Add K fl to the open -loop frequency response — (s) and 
re-evaluate the closed-loop frequency response 


^ (s) 


(s) 


1 +f ( s) 


S - jtd 


(4.29) 
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5) Check droop and scan for the corrected 

ifi • 

c max 

Some of the benefits of using the OCM model are evident in the 
results of Figure [4.5] corresponding to the configurations summarized 
in Appendix C. Of particular interest are those vehicles the Neal and 
Smith approach failed to place in the correct "areas". In one instance, 
configuration 8A appeared in the level one area, although it received a 
level 2 rating. We were able to not only identify it properly as level 
2, but placed the aircraft next to another configuration (3A) with 
different short period characteristics, but sharing the same pilot 
comments and pilot ratings (4-5). Other examples, such as level -3 
configuration 2G were incorrectly placed in the level 2 area by Neal- 
Smith. Once again, the OCM approach predicted a PIO problem serious 
enough to warrant a level 3 rating. In cases correctly rated by Neal 
and Smith, agreement was almost always attained by the OCM approach. 
Configurations 2C, 7C, and 2D were all given high marks in acquiring 
the target, which exemplifies the level 1 rating predicted by both 
methods. In only two cases evaluated (2E, 2F) did the OCM method yield 
marginal results. These configurations are on the level 1 - level 2 
boundary, and only one rating data point was obtained for each configu- 
ration. 
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CHAPTER 5 
SUMMARY 


5.1 Summary and Conclusions 

The main objective of this research has been to incorporate the 
benefits of the optimal control model with the basic framework of Neal 
and Smith's "pilot-in-the-loop" analysis to effectively create a more 
powerful tool for predicting pilot opinion rating. Indeed, by 
minimizing many of the shortcomings of the so-called "classical" model, 
and by preserving the simplicity found in the closed-loop frequency 
response, the OCM has led to an improvement in a method handicapped by 
the validity of the pilot model and the difficulty in obtaining it. 

Consider then, the following benefits resulting from the new 
approach. 

1) The OCM has the capacity to better represent complex pilot 
compensation likely to be present in the control of high-order dynamics, 
in contrast to being restricted to the lead-lag compensation of Neal 
and Smith. 

2) Use of the OCM reflects more correctly the actual experimental 
situation, incorporating the effects of human factors in modeling the 
tracking task. 

3) The linear time invariant structure of the OCM makes it 
equally suitable for analysis in the frequency domain, such as Neal and 

/ Smi th . 
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4) Use of the OCM gives the new method more flexibility over the 
Neal and Smith method in that more complicated tasks involving 
additional loop closures can be tackled easily in its state space 
format. 

5) The Neal -Smith pilot model parameters (K. T , T ) have to 

p H p 2 . 

be chosen to meet a certain standard of low-frequency performance 
whereas the OCM "automatically" leads to the optimal solution to do the 
best job (of task execution) possible subject to human limitations. 

6) The task performance in terms of droop and bandwidths now 
varies from configuration to configuration. 

7) More importantly, the new approach eliminates the critical 
task of pre-selecting bandwidth in favor of selecting more fundamental 
physiological limitations such as neuromotor lag. 

8) Also, the analysis demonstrated that an inability to obtain 
suitable bandwidth analytically correlates well with the bandwidth- 
related problems (i.e. large initial response delays) encountered in 
flight. 

In conclusion, the method provides a promising alternative to the 
classical Neal and Smith "pilot-in-the-loop" analysis, with what is 
considered a better pilot modeling procedure. 

5.2 Areas of Further Study 

To reflect the oscillatory tendencies experienced by the pilot, a 
"DC" gain, adjusted to reach a "suboptimal" level of performance, was 
added to the OCM results. Just how valid this step is relies on its 
underlying assumption; that a trade-off exists between attaining low- 
frequency performance and minimizing oscillatory tendencies. This 
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assumption can only be scrutinized with more piloted simulations over 
a wide range of FCS/aircraft dynamics. 

As a confirmation of this study, one may consider applying the 
method to more complex task such as approach and landing. Smith's LAHOS 
(Landing and Approach of Higher Order Systems) Report [7 ] stated that 
extrapolating the original closed-loop Neal/Smith criterion failed to 
reveal pitch attitude problems experienced in landing. Perhaps 
neglecting the additional loop closures required to perform the approach 
and landing task was the classical approach's undoing. 

Of course, this is not a problem for the OCM. What is a problem 
and requires further investigation is how to select the cost functional 
weightings representative of the pilot's strategy to perform such a 
task. 
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APPENDIX A 

SIMPLIFYING THE TOTAL COST OF SECTION 3.2 

Problem: Reduce the total cost of Section 3.2, 

J(u) = tr(Qi) + tr(Q V 5 eC V 1 CEe A ’ S ds) 

I 

+ tr(Ke AT Ec'v‘ 1 CEe A T ) (A.l) 

to the form Kleinman developed in Ref [3]. 

Solution: To simplify this expression of total cost, subsitute the 

known steady-state equality 

ecVce = Ae + EA* + W (A. 2) 

into Eq. (A.l) 

fT ' 1 

0(u) = tr(QE) + tr(Q e A? We A ? d£) + tr(Ke At We A T ) 

•*o 

+ tr(Q e A? (AE + eA )e A ? d E.) 

Jo 

I 

+ tr(Ke Ax (AE + eA )e A T ) (A. 3) 

At first glance, this expression looks worse than the previous one, but 
take heart, for some sweat and algebraic matrix manipulation will bring 
the last two terms into a cleaner form. First, expand the integral of 
the fourth term to 
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e A ^(Ai + lA )e A 5 df; 


e A5 Aze A + 


e^lA e k ? d5 


(A.4) 


Integrating the second term of Eq„ (A.4) by parts 


r e A ^zA e A ^d£ - e As ze A 5 | 
o o 


C e A5 A Se A c dc , (A. 5) 


simplifies the expression to 


e A5 (A l + lA )e A ? dg 


e Ax ze A T - z 


(A. 6) 


Furthermore, taking advantage of the commutative property that exists 

At 

between matrices A and e , and using the trace identity, 

tr(NM) = tr(MN) when N(nxm) and M(mxn) 

the last term of Eq. (A. 3) can be directly expressed as a combination 
of 


tr(Ke AT zA e A T ) = tr(Ke AT ze A T A ) 


tr(A* Ke Ax ze A T ) 


(A. 7) 


and 


tr (Ke Ax Aze A T ) » tr (KAe AT ze A ' T ) 


(A. 8) 


to give the desired form 



79 


tr(Ke Ax (AE + eA* ) e A T ) = tr((KA + A'K)e Ax Ee A T ) (A. 9) 


This expression combined with Eq. (A. 6) reduces the total cost to 


J(u) = tr (Q 


V 5 We A c ds) + tr (Ke Ax We A T ) 


+ tr ( (KA + a'k + Q)e Ax Ee A x ) 


(A. 10) 


Observing that the matrix Ricatti equation may be expressed as 

i *i * *i 1/2 1/2 * 

KA + AK+Q = L RL = L R R L (A.11) 

the third term of Eq. (A. 10) collapses neatly to tr(L R^R^L e Ax i 

I 

A T \ 

e ).. This term is brought into final form by using the trace 
identity, previously cited. 

tr(L* 1 R 1 ' 2 R 1 / 2 L V x Ee A ' x ) = tr (R 1 / Ve Ax ie A V‘ R 1 ' 2 ) 


= tr(L e EL' e ) 


where L = R^ 2 L e Ax 
e 


(A. 12) 


Making the appropriate substitutions, the total cost is 


0(u ) = tr(Q 


e A ^We A ? ds) + tr(Ke Ax We A x ) 


+ tr ( L e^ L e ) • 


(A. 13) 


the same as Kleinman developed in Ref. [3], 


C. 
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APPENDIX B 

FORMULATION OF THE STATE COVARIANCE MATRIX FOR SECTION (3.2) 

The simplest method of producing the covariance matrix follows 
directly from noting the actual state x(t) is the sum of two orthogonal 
components 

a 

x(t) = x(t) + e(t) (B.l ) 

a 

with e(t), the estimation error and x(t)» the least-mean-square 
estimate of x(t) where t replaces t - x since in this steady-state 
development t tends to infinity. Equation (B.l) can be expanded 
further by recalling that x(t) is also the sum of orthogonal components 
as a result of the prediction process. Thus 

x(t) = y(t) + e p (t) (B.2) 

with e (t), the prediction error and y(t), the least-mean-square pre- 

* a 

diction of x(t). Since x(t) is orthogonal to the estimation error 
e(t) s the orthogonal decomposition of x(t) is also orthogonal to e(t)» 
Hence, the following relationship hold 

lim E{e(t)e (t) } = 0 
t-*- p 

lim E{e(t)y ( t) > = 0 (B.3) 

t -^ 00 
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and of course 

lim E{e (t)y’(t)} = 0 
P 


Thus, the steady-state, state covariance can be expanded, accordingly 


lim E{x(t)x ( t) } + lim E{y(t)y (t)> 
t-x» t-*°° 


+ E{ip(t)ip (t)} + E{e(t)e (t)} 


(B.4) 


with the first term, derivable from the solution of Eq. (3.44) 


y(t) = e^S(O) + 


e S(t ' o) w 2 (<i)d<, 


(B.5) 


with A = A - BL and y(o) = 0. Thus 


E{y(t)y (t)} = 


t A 


e (t-o) e Axft e A x e A (t-o) do 


f t e^(t" p )' e A T E C , V “ 1 C E e A T e A (b.6) 


Letting t go to infinity, 


lim E{y(t)y (t) } = 

t-H» 


e Aa e AT zc'v" 1 Cze A T e A °da (B.7) 


The covariance of the prediction error has already been evaluated in 
finding the total cost. Thus, 

•t 

€ 
o 


lim E{i (t)e ' (t) } = 

t->«0 ' ' r 


r e A «»e A 5 d ? 



82 


= [ T e Ac £C ' V" 1 Cf e A ? d£ , 

JQ 

and 

* e A-r ze A T - z + f e A? We A 5 dc (B.8) 

■*0 

from Eq. (3.39), Eqs. (A.l) - (A. 6). L,astly 3 the third term of Eq. 
(B.4) is simply the definition of Z. Hence s summing the three terms 

E{x(t).x‘ ( t) } * e AT ie A T + fe A5 We A 5 d? . 

•>o 

f co - 1 - * 

+ (e Ao e AT zC V 1 Cie A T e A °)dc. (B.9) 

•’o 

reproduces Kleinman's closed- form expression of the state covariance 

matrix. 
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APPENDIX C 

SUMMARY OF OCM RESULTS 

CONFIGURATION 1A 




Figure C.l Configuration l.A/Pilot Frequency Response 
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CONFIGURATION 1A 





W( RAO/SEC ) 


Figure C.2 Configuration lA/System Frequency Response 
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CONFIGURATION 1A 
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Figure C.3 Configuration lA/Corrected System Frequency Response 
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CONFIGURATION IB 
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Figure C.5 Configuration IB/System Frequency Response 
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CONFIGURATION 1C 




Figure C.7 Configuration 1 C/Pi 1 ot Frequency Response 
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CONFIGURATION 1C 



Figure C.9 Configuration IC/Corrected System Frequency Response 
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CONFIGURATION ID 




Figure C.11 Configuration ID/System Frequency Response 
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CONFIGURATION IE 
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Figure C.14 Configuration 1 E/System Frequency Response 
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CONFIGURATION IE 



W( RFIO/SEC ) 


Figure C.15 Configuration 1 E/Corrected System Frequency Response 
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Figure C.18 Configuration IG/Pi lot Frequency Response 
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CONFIGURATION 1G 
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Figure C - 1 9 Configuration IG/System Frequency Response 
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CONFIGURATION 2fl 
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Figure C.21 


Configuration 2A/System Frequency Response 
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CONFIGURATION 2A 
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Figure C.22 Configuration 2A/Corrected System Frequency Response 
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CONFIGURATION 2B 




Figure C.23 Configuration 2B/Pilot Frequency Response 










107 


CONFIGURATION 2B 
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Figure C.25 Configuration 2B/Corrected System Frequency Response 
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CONFIGURATION 2C 
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Figure C.26 Configuration 2C/Pilot Frequency Response 
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CONFIGURATION 2C 




Figure C.27 Configuration 2C/System Frequency Response 
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Figure C,28 Configuration 2C/Corrected System Frequency Response 
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CONFIGURATION 2D 



W( RAO/SEC ) 



Figure C.29 Configuration 2D/Pi lot Frequency Response 
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CONFIGURATION 2D 
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Figure C.31 Configuration 2D/Corrected System Frequency Response 
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CONFIGURATION 2E 
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Figure C - 32 Configuration 2E/Pilot Frequency Response 
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CONFIGURATION 2E 
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Figure C.33 Configuration 2E/System Frequency Response 
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Figure C.34 Configuration 2E/Corrected System Frequency Response 
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CONFIGURATION 2F 
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Figure C.35 Configuration 2F/Pi lot Frequency Response 
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CONFIGURATION 2F 
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Figure C.36 Configuration 2F/System Frequency Response 
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CONFIGURATION 2F 
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Figure C.37 Configuration 2F/Corrected System Frequency Response 
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CONFIGURATION 2G 




Figure C.39 Configuration 2G/System Frequency Response 
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CONFIGURATION 2G 



Figure C-40 Configuration 2G/Corrected System Frequency Response 
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CONFIGURATION 2H 
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Figure C.41 Configuration 2H/Pi lot Frequency Response 
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CONFIGURATION 2H 
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Figure C.43 Configuration 2H/Corrected System Frequency Response 
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CONFIGURATION 21 
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Figure C.44 Configuration 21/Pilot Frequency Response 
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CONFIGURATION 21 
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Figure C.45 Configuration 21/System Frequency Response 
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CONFIGURATION 21 
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Figure C.46 Configuration 21/Corrected System Frequency Response 
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CONFIGURATION 2J 
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Figure C.47 Configuration 2J/Pi lot Frequency Response 
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CONFIGURATION 3A 
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Figure C.49 Configuration 3A/Pilot Frequency Response 
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CONFIGURATION 3A 
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Figure C.50 Configuration 3A/System Frequency Response 
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CONFIGURATION 3A 
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Figure C.51 Configuration 3A/Corrected System Frequency Response 
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Figure C.52 Configuration 4A/Pi1ot Frequency Respons 
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CONFIGURATION 4fl 
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Figure C.53 Configuration 4A/System Frequency Response 
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CONFIGURATION 4A 
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Figure C.54 Configuration 4A/Corrected System Frequency Response 
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CONFIGURATION 5A 




Figure C.55 Configuration 5A/Pilot Frequency Response 
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CONFIGURATION 5A 
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Figure C.57 Configuration 5A/Corrected System Frequency Response 
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CONFIGURATION 6C 
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Figure C.58 Configuration 6C/Pilot Frequency Response 
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CONFIGURATION 6C 



Figure C.59 Configuration 6C/System Frequency Response 
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CONFIGURATION 6C 
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Figure C.60 Configuration 6C/Corrected System Frequency Response 
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CONFIGURATION 7C 




Figure C.61 Configuration 7C/Pi lot Frequency Response 
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CONFIGURATION 7C 
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Figure C.63 Configuration 7C/Corrected System Frequency Response 
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CONFIGURATION 8A 




Figure C.64 Configuration 8A/Pilot Frequency Response 
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CONFIGURATION 8R 



Figure C.65 Configuration 8A/System Frequency Response 
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